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Abstract 

In this paper, we introduce a new method for solving variational inequality problems with 
monotone and Lipschitz-continuous mapping in Hilbert space. The iterative process is 
based on two well-known projection method and the hybrid (or outer approximation) 
method. However we do not use an extrapolation step in the projection method. The 
absence of one projection in our method is explained by slightly different choice of sets in 
hybrid method. We prove a strong convergence of the sequences generated by our method. 
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1 Introduction 

We consider the classical variational inequality problem which is to find a point x* C C such 
that 

(Ax*,x — x*) > 0 Vx e C, (1) 

where C is a closed convex set in Hilbert space H, (•, ■) denotes the inner product in H, and 
A: H —> H is a some mapping. We assume that the following conditions hold 
(Cl) The solution set of (1), denoted by S, is nonempty. 

(C2) The mapping A is monotone, i.e., 

(Ax — Ay,x — y) > 0 Vx, y € C. 

(C3) The mapping A is Lipschitz-continuous on C with constant L > 0, i.e., there exists 
L > 0, such that 

II Ax — Ay || < L ||x — y || Vx, y € C. 

Variational inequality theory is an important tool in studying a wide class of obstacle, 
unilateral, and equilibrium problems arising in several branches of pure and applied sciences 
in a unified and general framework [3,4,12,17, 18,24]. This field is dynamic and is experiencing 
an explosive growth in both theory and applications. Several numerical methods have been 
developed for solving variational inequalities and related optimization problems, see books 
[7, 11, 18] and the references therein. In order to construct an algorithm which provides strong 
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convergence to a solution of (1) we propose the following method 

Algorithm 1 

{ x 0 ,z 0 € C, 

Zn+l = Pc(x n - AAZn), (2) 

x n+l = Pc n nQn X 0> 

where Pm denotes the metric projection on the set M, A G (0,1 /2L), the sets C n and Q n are 
some halfspaces which we will define in the Section 4. 

2 Relation to the previous work 

There are two general approaches to study variational inequality problem under the condi¬ 
tions above: regularization methods and projection methods. As far as we are concerned, we 
prioritize the latter; good survey of regularization methods can be found in [5, 18]. 

The oldest algorithm which provides convergence of the generated sequence under the above 
assumptions is the extragradient method proposed in 1976 by Korpelevich [19] and Antipin [1]. 
A lot of efficient modifications exist at this moment [2,8,10,14-16,21,23,27,29,30]. The natural 
question that arises in the case of infinite dimensional Hilbert space is how to construct 
an algorithm which provides strong convergence. To answer this question Nadezhkina and 
Takahashi [23] introduced the following method 
Algorithm 2 

x 0 € C, 

Un = P c( x n AAx n ), 

< Zn = Pc( x n — AAy n ), 

C n ={w(EC: ||Zn-w|| < ||x n -w||}, 

Q n = {w £ C: (x n - w, x 0 - x n ) > 0}, 

^n+1 = PcnnQn*o> 

where A £ (0,1/L). Under the above assumptions (C1)-(C3) they proved that the sequence 
(x n ), generated by (3), converges strongly to Ps*c). Their method based on the extragradient 
method and on the hybrid method, proposed by [25,28]. The computational complexity of (3) 
on every step is three computation of metric projection and two values of A. 

Inspired by this scheme, Censor, Gibali and Reich [9] presented the following algorithm 
Algorithm 3 

Xq £ H, 

hn = P c( x n AAx n ), 

T n = {w £ H: (x n AAx n - y n , w - y n ) < 0}, 

< Zn = ^n x n T (1 tx n)PT n ( x n AAy n ), (4) 

C n ={w£H: ||zn-w|| < ||x n -w||}, 

Qn = {w £ H: (x n w,x 0 - x n ) > 0}, 

Qn+1 = Pc n nQn x o> 

where A £ (0,1 /L) and (a n ) C [0, a] for some a £ [0,1). In contrast to (3) the sets C n and Q n 
are halfspaces and hence it is much more simpler to calculate Pc n nQ n x 0 than projection onto 
the general convex set C. Therefore in the next schemes we will not take into consideration 
this projection. Also on the second step it is calculated only a projection onto halfspace T n 
but not onto set C like in (3). However on every step of (4) we need to calculate two values 
of A as well as in (3). 
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Using hybrid method it is not difficult to modify Tseng algorithm [29] 

Algorithm 4 

Un = P C (*n AAx n ), 

2-11 = yn T A(Ax n Ay n ), 

< (5) 

C n ={weH: ||zn - w|| < ||x n - w||}, 

Qn = {w G H: (Xn - W, X 0 - X n ) > 0}, 
v x n+i = Pc n nQn x o, 

where A € (0,1 /L). In computational sense it is similar to (4). 

In this work we show that with some other choice of sets C n it is possible to throw out in 
(3) or in (4) the step of extrapolation which consist in y n = Pc(x n — AAx n ). We emphasize 
that in order to prove a convergence of Algorithm 1 we use an idea due to Popov [26] (the 
refinement of this idea see also in [22]). It is easy to see that our method (2) on every iteration 
needs only one computation of projection (as in (4) or (5)) and only one value of A. For 
example, very often variational inequality problems which arise from optimal control, provide 
a very complicated operator such that only computation of the latter is a very sophisticate 
problem. (For more details see [20]). 

3 Preliminaries 

In order to prove our main result, we need the following statements (see books [3,4,7,17]). At 
first, the following well-known properties of the projection mapping will be used throughout 
this paper. 

Lemma 1. Let M be nonempty closed convex set in H, x € H. Then 
i) (Pjvi x — x, y — Pjvix) > 0 Vy <E M; 
h) ||Pmx —y|| 2 < ||x — y || 2 — ||x — P M x|| 2 Vy G M. 

Next two lemmas are also well-known. 

Lemma 2 (Minty). Assume that A : C —> H is a continuous and monotone mapping. Then 
x* is a solution of (1) iff x* is a solution of the following problem 

findx € C, such that (Ay,y — x) > 0 Vy £ C. 

Remark 1. The solution set S of variational inequality (1) is closed and convex. 

We write x n — 1 x to indicate that the sequence (x n ) converges weakly to x. x n —> x implies 
that (x n ) converges strongly to x. 

Lemma 3 (Kadec-Klee property of a Hilbert space). Let (x n ) be a sequence in H. Then from 
||x n || —» j|x|| and x n — i x follows that x n —> x. 

At last, we prove the following result. 

Lemma 4. Let (a n ), (b n ), (c n ) be nonnegative real sequences, a, |3 £ R and for all n G N 
the following inequality holds 

a n < b n - ac n+ i + |3c n . (6) 

If I“, W < Too and oc > (3 > 0 then lim n ->oo <in = 0. 
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Proof. Using inequality (6) for n=l,n = 2,..., n = N we obtain 

a.1 < bi — ac2 + (3ci, 

ci2 < b2 — aC3 + (3 c 2 , 

UN < b N - ac N +i + (3 c n . 

Adding all these inequalities yields 

N N N oo 

Z Q n<Z b - — (a — (3) ^ c n — acN+i + |3ci < ^ b n + (3ci. 

n=1 n=1 n=2 n=1 

Since N is arbitrary, we see that series a n is convergent and hence a n —> 0. □ □ 

4 Algorithm and its convergence 

Now we formally state our algorithm. 

Algorithm 1 (Hybrid algorithm without extrapolation step). 

1. Choose Xo,Zo £ C and two parameters k > 0 and A > 0. 

2. Given the current iterate x n and z n , compute 

Zn+1 = f > c( x n AAz n ). (7) 

If z n+ i = x n = z n then stop. Otherwise, construct sets C n and Q n as 
C 0 = H, 

C n = {w £ H: ||Zn+1 -w|| 2 < llXn-wl^ + kllXn-Xn^-ill 2 

- (1 - ^ - AL) ||zn +1 -z n || 2 + AL ||z n -Zn -1 || 2 }, n>l, (8) 

Qo = H, 

Q n ={w £ H: (x n -w,x 0 -x n ) > 0}, n > 1, 

and calculate 

x n +l = p c n nQn x o- (9) 

3. Set n <— n + 1 and return to step 2. 

We remark that sets C n look a slightly complicated in contrast to (4). However it is only 
for superficial examination, for a computation it does not matter. In (8) and in (3) both C n 
are some halfspaces. 

First we show that the stopping criterion in Algorithm 1 is valid. 

Lemma 5. If Zn + i = x n = Zn in Algorithm 1 then x n £ S. 

Proof. From (7) and Lemma 1 follows 

A(Ax n ,y-x n ) > 0 Vy £ C. 

Since A > 0, we have x n £ S. □ □ 
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Next lemma is central to our proof of the convergence theorem. 

Lemma 6. Let (x n ) and (zn) be two sequences generated by Algorithm 1 and let z £ S. Then 


11 Zn +1 z|| fs +n z|| t k ||x n X n — 1 || 


1 


- (1 - ^ - AL) HZn+i -ZjtH + AL \\Zn — Zn_i ||“ . (10) 

Proof. By Lemma 1 we have 

||Zn +1 z|| £ ||x n AAZn z|| ||x n AAZn Zn +1 || 

= +n Z|| ||x n Z n +1 || 2A(AZn, Zn +1 z). (11) 

Since A is monotone and z £ S, we see that 

(Azn,Zn -z) > 0. 

Thus, adding 2A(Azn,Zn — z) to the right side of (11) we get 

||Zn+1 Z|| A ||Xn z|| ||x n Zn +1 || 2A(AZn> Zn +1 Zn) 

= || x n Z11 ||x n X n _i || 2(x n X n _l, X n —1 Zn+1) 

+n —1 Zn +1 || 2A(Az n ,z n +i Z n ) = ||x n z|| 

2 2 

||^n ' *n—1 || 2(x n ^ti— 1 > X n —1 ^n+1) ||^n— 1 ^tl 11 

2 

ll^ri 2^1+1 || 2(x n _i Zn, Zrt Zn+ 1 ) 2A( AZn Az n ^-|, Zn +1 Zn) 

2A(AZn_i, Zn +1 Zn) = ||x n z|| ||x n X n —1 || 

2 112 

2(x n ^n—1) ^n—1 Zn+1) ll^-n—1 Zn || ||Zn Zn+1 || 

2A(Az n Az n — 1 , Zn +1 Zn) + 2(x n -1 AAZn —1 Zn,Zn +1 Zn). (12) 
As Zn = Pc (Xn_i — AAZn- 1 ) and Zn + -\ £ C we have 

(x n _l AAz n -1 Z n , Zn +1 Zn) A 0. (13) 

Using the triangle, the Cauchy-Schwarz, and the Cauchy inequalities we obtain 

2(x n X n —1, X n —1 Zn+1) ^ 2 11X n Xu— 1 || 11X n —1 Z n || + 2 ||x n X n —1 || ||Zn Zn+1 || 

A 11X n X n —l || _ + 11X n — 1 Zn|| A L 11X n X n — 1 || A ~ ||Zn+1 Zn || . (14) 

Since A is Lipschitz-continuous, we get 

2A(AZn AZn— 1 , Zn +1 Zn) A 2AL ||z n Zn _1 || ||Zn +1 Zn || 

<AL(||2^n+l Zn|| A 11Z n Zn—1 || ). (15) 

Combining inequalities (12) - (15), we see that 

11Zn +1 Z11 A +n z|| A k ||x n X n — 1 || (1 ~ AL) 11Zn +1 Zn|| A AL ||z n Zn —1 || , 

which completes the proof. □ □ 

Now we can state and prove our main convergence result. 
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Theorem 1. Assume that (C1)-(C3) hold and let A E (0, ji) ; k > 1 • Then the sequences 

(x n ) and (Zjt) generated by Algorithm 1 converge strongly to PsXo- 

Proof. It is evident that sets C n and Q n are closed and convex. By Lemma 6 we have that 
S C C n for all n £ Z + . Let us show by mathematical induction that S C Q n for all n € Z + . 
For n = 0 we have Qo = H. Suppose that S C Q n . It is sufficient to show that S C Qn+i • 
Since x n+ i = Pc n nQ n x o and S C C n n Q n , it follows that (x n+ i — z,Xo — x n+ Q > 0 Vz £ S. 
From this by the definition of Q n we conclude that z E Qn+1 Vz £ S. Thus, S C Q n+ i and 
hence S C C n fl Q n for all n E Z + . For this reason the sequence (x n ) is defined correctly. 

Let x = PsXo- Since x n+ i G C n fl Q n and x G S C C n fl Q n , we have 

||*n+1 -X 0 || < ||X-X 0 || . (16) 


Therefore, (x n ) is bounded. From x n+ i G C n Fl Q n C Q n and x n = Pq u xo, we obtain 

||*n-X 0 || < ||x n+1 X 0 11 . 

Hence, there exists limn^oo ||x n — Xq||. In addition, since x n = Pq^X-o and x n+l £ Qn by 
Lemma 1 we have 

|| x n+1 *n|| ^ ||*n+1 *oll || x n *o|| • (17) 

From this it may be concluded that series YY ^ ||x n+ i — x n || 2 is convergent. In fact, from (17) 
and (16) we obtain 

N N 

y ll^-n+l *-n|| — y (ll^-n+1 *o|| ||*-n ^o|| ) — ||^ ^o|| 11^1 ^o|| • 

n=l n=l 


Since x n+ i G C n , we see that 
||^n+1 ^n+1 || — ||*n+1 *n|| T k ||x n X n _i || 

1 2 

(1 ^ ^h) ll^n+l || T AL IjZn 2^—1 


Set 


a n — ||Zn +1 X-n-i-l || , b n — ||x n _|_i Xn|| T k ||x n X n _l || , 

2 1 

Cn = ll^n Zn._l || , Oi = ( 1 — AL), (3 = AL. 

By Lemma 6 since b n < +oo and a > (3, 

lim ||zn -x n || = 0. 

n —>oo 

For this reason (zn) is bounded and 

ll^n +1 Znll V ||Zn +1 X n _|_i || + ||x n _|_i Xn|| T ||x n Zn)) > 0. 

As (x n ) is bounded there exist a subsequence (x n J of (x n ) such that (x n J converges weakly 
to some x* G H. We show x* G S. 

From (7) by Lemma 1 it follows that 

(Zn l+ 1 -x ni + AAzn t ,y-Zn l+1 ) > 0 Vy G C. 
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This is equivalent to 


0 < (Zn t+ 1 -Zn t +Zn t -X ni ,y ~ Zn i+ ]) + A(AZn u y - Zn J 

+ A(Az nt ,Zn i -Zn.. +1 ) < (Zn l+1 -Z^y - Zn l+1 ) + (z^ - X Ui , y - Z^+i) 

+ A(Ay,y-ZnJ + AfAzn^Zrn-Zn l+ i) Vy € C. (18) 

In the last inequality we used monotonicity of A. 

Taking the limit as i —> oo in (18) and using that z ni — L x*, we obtain 

0<(Ay,y-x*) Vy € C, 

which implies by Lemma 2 that x* € S. 

Let us show x nt —» x*. From x = PsXo and x* G S it follows that 

||x — xq|| < ||x* — xo|| < liminf ||x ni — xo|| = lim ||x ni — xo|| < ||x — xq|| . 

i—>oo i—>oo 

Thus, 

lim ||x ni — x 0 || = ||x* — x 0 11 - 

i—)oo 

From this and x ni — xo — i x* — Xo by Lemma 3 we can conclude that x ni — Xo —> x* — xo- 
Therefore, x nt —> x*. 

Next, we have 

||x ni -x|| 2 = (x tli -x 0 ,x ni -x) + (x 0 -x,x ni -x) < (x 0 -x,x ni -x). 


x. It is 

□ 

5 Computational Experience 

In this section we compare the performance of Algorithms 1, 3 and 4 which provide a strong 
convergence in Hilbert space. We have already noted that the main advantage of our algorithm 
is a computation on every step only one value of operator. But we will show that it has 
competitive performance even on simple examples where the previous reasoning has no impact. 
Of course all examples are considered in M m , therefore there is no sense to use any of algorithms 
1,2,3,4 to obtain the solution of variational inequality. However there are many problems 
that arise in infinite dimensional spaces. In such problems norm convergence is often much 
more desirable than weak convergence (see [6] and references therein). For this reason strong 
algorithms 1,2,3,4, can be better than extragradient algorithms that provide weak convergence. 
Another reason to study their convergence is an academic interest. 

Although Algorithm 2 gave birth to all strong algorithms mentioned above, we do not 
report its results since Algorithm 2 requires a large amount of projections onto a feasible set 
which are not trivial for our test problems. 

We describe the test details below. Computations were performed using Wolfram Mathe- 
matica 8.0 on an Intel Core i3-2348M 2.3GHz running 64-bit Linux Mint 13. 

In all tests we take A = 1 /(4L), k = 3 in Algorithm 1 and a n = 0.5 in Algorithm 3. The 
projection onto a feasible set C is performed using the cyclic projection method with error 
e. The time is measured in seconds using the intrinsic Mathematica function Timing. The 
termination criterion is ||x — Pc(x — AAx)|| < £. The projection in Algorithms 1, 3, 4 onto the 


As I —» oo, we obtain 

||x* - x|| 2 < (x 0 - x, x* - x) < 0. 

Hence we have x* = x. Since the subsequence (x n J was arbitrary, we see that x n 
clear that Zn —> x. □ 
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intersection C n n Q n of two halfspaces is explicit and is given by Haugazeau formula (see [7] 
for more details). 

The first example is very simple. The feasible set C C R 5 is a random polygon with 10 
linear constraints and Ax = x — u where u is a random point in R 5 . It is clear that the 
solution x* of variational inequality (1) is the point Pcu. For this problem we take L = 1 and 
e = 0.01. We study this problem for a different choice of starting points xo- The results for a 
three different choices of starting point xq are shown in Table 1. 



Ex. 1 

Ex. 2 

Ex. 3 

Iter. 

Time 

Iter. 

Time 

Iter. 

Time 

Alg. 1 

307 

61.1 

271 

52.1 

137 

29.4 

Alg. 3 

317 

60.4 

315 

58.1 

276 

52.5 

Alg. 4 

518 

97.1 

312 

58.9 

221 

42.9 


Table 1 


Of course this result depends on a feasible set. However our purpose was only to study some 
examples where Algorithm 1 is effective. 

The second problem is the following. We take Ax = Mx + q with the matrix M randomly 
generated as suggested in [13]: 

M = AA t + B + D, 

where every entry of the n x n matrix A and of the n x n skew-symmetric matrix B is 
uniformly generated from (—5,5), and every diagonal entry of the nxn diagonal D is uniformly 
generated from (0,0.3) (so M is positive definite), with every entry of q uniformly generated 
from (—500,0). The feasible set is 


C = {x € R+ | xi + %2 H-f- x m j= m}, 

and the starting point is Xo = (1,...,1). For this problem we take L = ||M||. We have 
generated three random samples with different choice of M and q for both cases n = 2 and 
n = 10, the results are tabulated in Table 2 and 3. 

For n = 2, i = 0.001 



Ex. 1 

Ex. 2 

Ex. 3 

Iter. 

Time 

Iter. 

Time 

Iter. 

Time 

Alg. 1 

245 

4.9 

216 

34.7 

385 

463.7 

Alg. 3 

278 

5.7 

219 

35.1 

349 

412.8 

Alg. 4 

291 

6.0 

187 

30.0 

268 

320.0 


Table 2 


And for n = 10, i = 0.01 



Ex. 1 

Ex. 2 

Ex. 3 

Iter. 

Time 

Iter. 

Time 

Iter. 

Time 

Alg. 1 

4267 

123.6 

2728 

32.7 

554 

15.3 

Alg. 3 

2571 

75.9 

1826 

29.2 

409 

12.1 

Alg. 4 

2564 

76.4 

1632 

48.3 

522 

16.0 


Table 3 


As one can see, on our examples Algorithm 1 has competitive performance. We caution, 
however, that this study is very preliminary. 
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